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Abstract : We discuss one construction of nonstandard subgroups in the category of Coxeter groups. 
Two formulae for the growth series of such a subgroups are given. 

As an application we construct a flag simple convex polytope, whose f-polynomial has non-real roots. 

Introduction 

The central object of this paper is the growth series of a Coxeter group. Many geometric features 
of such a group (or any group in general) reflect in properties of the growth series. 

We describe in detail the normal closure of a standard parabolic in a Coxeter group W. It is again 
a Coxeter group and its Coxeter presentation is given explicitly. 

We give two formulae for the growth series of such a normal subgroup. The first one is given as a 
specialization of a multi-variable version of the growth series of W. 

The second formula works when the normal subgroup is right-angled (this can be easily checked 
by analysis of the Dynkin diagram of W). The formula is based on counting special subdiagrams 
of the Dynkin diagram of W. 

As an application we construct a flag simple convex polytope, whose f-polynomial has non-real 
roots. 

The author would like to thank Tadeusz Januszkiewicz for useful discussions, Pawel Goldstein for 
his extensive help with the final version of this manuscript and Mike Davis for a preliminary version 
of [D2]. 

1. Preliminaries on Coxeter Groups 

Definition. A Coxeter system (W, S) is a group W together with a set of generators S, and presen- 
tation 

W= (S|(st) mst = 1 for all s, t G S), 

where m ss = 1 (i.e. all the generators have order two) and m st = m ts € {2,3,..., oo} if s^t. 
One reads (st)°° = 1 as no relation between s and t imposed. The matrix m is called the Coxeter 
matrix of W. We usually ignore S and call W a Coxeter group. The subgroup of W generated by 
T C S is denoted Wj. Such a subgroup is called a standard parabolic or parabolic for short. 

Traditionally a Coxeter matrix is depicted in a following decorated graph called Dynkin diagram. 
Its vertex set is S and any two distinct vertices are joined by an edge with label m st . By convention 
• we omit an edge if m st = 2, 
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• we omit a label if m st = 3, 

• we draw double edge instead that labeled by 4 and 

• we draw dashed edge instead that labeled by oo. 

We will use the following convention for the Cayley graph: the group acts on the left, therefore 
{gi , g2} is an edge provided gf 1 g2 £ S. We say that an edge {gi , gz} is markedby the generator 



Theorem 1.1 [D2]. Let W be a group generated by a set of involutions S. Let Cw be the Cayley 
graph of (W, S) . Then (W, S) is a Coxeter system if and only if for any element s G S the fixpoint 
set (Cw) s separates Cw Cw — (Cw) s has two components being interchanged by s). 



Definition. A conjugate of a generator from S is called a reflection. The set of all reflections is 
denoted by R(W) . 

Corollary 1.2. Reflections are intrinsically defined by a Coxeter system. Precisely, if T C S then 
R(W S ) n W T = R(W-r). 

Proof: Assume that r e R( Ws ) fl Wj . Since the action of r is conjugate to that of some generator, 
the fixpoint set of r also separates Cw Then r and the neutral element e are in different components 
of Cw s — (Cw s ) r , and thus in different components of Cw T ~~ (Cw T ) r - Take any path joining 
e and r in Cw T • Such a path has to intersect the separating fixpoint set (Cw T ) r in a midpoint of 
some edge {w, wt}. Thus rw = wt and, what follows, r = wtw" 1 e R(W T ). □ 

Definition. The length of an element w of any group with respect to a given generating set S is 
denoted by i(w) and is equal to the minimal length of a word in S representing w. The word is 
called reduced if its length is equal to the length of the element it represents. 

Lemma 1.3 [T]. If (W, S) is a Coxeter system than any word can be reduced (into any reduced 
word representing the same element of W) in a sequence of moves of the following form: 

(a) removing a subword of a form ss, or 

(b) replacing an alternating subword st . . . of length m st by an alternating subword ts ... of the 
same length. 

Note: The move (a) is not symmetric, i.e. we do not need creation of a pair ss. In particular any 
two reduced words representing the same element may be joined by moves of the form (b) only. 

2. Normal closure of a standard parabolic 

If m st = 2n + 1 is odd then s and t are conjugates since the relation reads then 




Proof: It is a part of Theorem 2.3.3 in [D2] (cf. [D2, Definitions 2.2.1 and 2.2.10]). 



□ 



(st) n s(st) 



— n 



= t. 



If one wants to find a normal closure of a subgroup W T it is convenient to incorporate in T all the 
generators conjugate to those already in T. This clarifies the assumption of the following 
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Proposition 2.1. Assume that T C S is such that for any t G T and s G S — T the exponent m st 
is even (or oo). Then 

(1) there exists a well defined homomorphism <$j: W — > Ws_y that is an identity on Ws-j and 
sends Wj to the identity element, 

(2) the normal closure W T of Wj is the kernel of cb T , 

(3) Wj is generated by Sj, a set of all the conjugates of T with respect to W s _j, 

(4) the Cayley graph C^r- of (W T , Sj) is made from the Cayley graph Cw of W by collapsing 
all the edges marked by the generators not in T, 

(5) (Wj, Sj) is a Coxeter system. 

Proof : Let t G T and s ^ T, then the relation st . . . = ts . . ., after substituting the identity for s, 
becomes trivial exactly when m st is even. Thus (1) follows. This also proves that the relation "s 
and t are conjugate" is the equivalence closure of the relation "m st is odd". 

Any element w of W may be written as follows 

(woUWq ] ) (woW 1 t 2 (w W 1 )~ 1 ) . . . (w . . .W n _lt n (w . . .WrL-l)" 1 ) (w . . .W n ) 

where ti G T and Wi G Ws-j. If e = cb-r(w) = Wo . . . w n then w is expressible in Sj, therefore 
(2) and (3). 

Let giUi , g2U-2, where gt G Wj and ut G Ws_t, be the endpoints of an edge corresponding 
to some generator in T, i. e. (giUi ) -1 g2U2 G T. In particular e = <h T (u^ 1 g^ 1 g2U2) = 
4> T (u^ 1 U2). Therefore ui = Uz- Furthermore 

g^g 2 = ut ((giui) _1 (g 2 ui)) uf 1 G S T . 

On the contrary, if gf 1 g2 = utu -1 , then the edge {gi , g2} in C^r- is covered by the edge 
{giu, g2u} in Cw This proves (4). 

Let t G Sj • By Theorem 1 . 1 we need to show that the fixpoint set of t separates C^-. Let W + and 
W~ denote the two components of Cw — (Cw) 1 - Two vertices, one from W + and the other from 
W~ are joined by an edge precisely when they differ by t on the right. Since t is not a conjugate 
of any element of Ws_t all the cosets of Ws-j have to lie in W + or W~ . Therefore the fixpoint 
set of t also separates C-^-. Thus (5). □ 

Remark 2.2: If Ws-j is not finite, then Wj has in general an infinite number of generators. 



3. Coxeter matrix of W T 

Definition. Define the support supp w of an element w of a Coxeter group to be the set of gener- 
ators that appear in its reduced presentation. By Lemma 1.3 this does not depend on the reduced 
presentation. 

Definition. Let Ti , T2 C S. We write T-\ _L T2 if m tl t 2 = 2 for any ti G Ti and tx G Ti . If 

T C S we define T 1 = {s G S: m st = 2 for all t G T}. 

Fix ti , t2 G T. Let w* be the shortest element in the double coset W t ±_ T wW t ±_ T . Such an 
element is unique [B, Ch. IV, §1, Ex. 3]. 
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Corollary 3.1. Letii = witiw^ 1 andrz = W2t2W 2 ~ 1 be two generators of W T . Thenx\ = T2 
if and only if 

ti = t 2 and (w^" 1 w 2 )* = l. 

If Ti 7^ T2 then we have 



m 



m tlt2 if ti 7^ t 2 and (w" 1 -^)* = 1, 
t,t 2 = <j H£±i. ift! = t 2 and (w^w 2 y = seS-T, 
00 otherwise. 



Proo/: Set w = (w 1 1 W2)*, so 



W 1 1 W2 = T|l WT|2 



for some Tlx e W t _L _ T . In particular ti commutes with r|t 

i 

Let N be a natural number such that 

(3.2) (tit 2 ) n = 1. 

Then (3.2) reads 



1 = T| 1 1 W 1 1 \V-\V\-\ = T| 1 1 W 1 1 ^Wi ti (w 1 1 W2)t2 1 W2) 1 . . WiT|i 
= Tir 1 ( t l( r ll wr l2)t2(r|lWTl2)" 1 ) T|i 

= (Tir 1 t 1 r)i)w(ri2t2ri 2 " 1 )w- 1 . . . 



= tiWt2W 1 



Lemma 1.3 implies that w has length at most one, otherwise no cancellation is possible since any 
reduced form of w does not start with a letter that commutes with ti nor ends with a letter that 
commutes with t2. 

The case t(yv) = is obvious. If w is a generator, then it commutes neither with ti nor with t2- 
The only possibility to use Lemma 1.3 is described by the claim. □ 



4. Multi-variable growth series. 

The length function on a Coxeter group may be refined in the following way. Take a set of generators 
So C S with the property that whenever s belongs to So, then all the generators conjugate to s belong 
to S . 

Lemma 1.3 implies the following 

Corollary. The number (counted with multiplicities) of generators from So appearing in a reduced 
presentation of w, and denoted Zs ( w )> does not depend on the presentation. 

Note that £s satisfies the triangle inequality, i.e. £s ( w i w i) < ^s ( w i ) + ^s (W2). 
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Let cp: S — > I be any partition of the generating set into the sets with the above property. We call 
such a partition allowable. For each w G W define a monomial in indeterminate I: w (p (x) = 

n X 6i x£ip " 1(x)(W) ' wh ere x = (x) xe i. 

For any subset A of W, a formal power series A v (x) = J2weA w <p ( x ) * s cai led a multi-variable 
growth series of A C W. 

The above definition needs some finiteness assumption on (W, S). It is enough to assume that S 
is finite (if not, the coefficients of the growth series may be infinite). Since we also want to study 
the growth series of Wj, we want to know that Sj is finite. Therefore, due to Remark 2.2, we will 
assume that W s _j is finite. 

The notation may look a little ambiguous. However, note that W<p does not depend on whether 
W is a standard parabolic subgroup of some bigger Coxeter group or not. Similarly (Wj) may 

denote two things: either a growth series of Wj or that of Wj C W. In fact these two series 
coincide, as shown by the following 

Proposition 4.1. Assume that T C S is as in Proposition 2.1 and cp -1 (xo) = S — T. There is a 
well defined prolongation cp T of cp to Sy by requiring that (p(wtw _1 ) = cp(t) for any t G T and 
w G W s _t- It is obviously allowable. Then 



(W T )cp T (x) = (W T )c P (x)| X0=1) 



where the left series is a growth series of W T and on the right that of W T C W. 

./Vote.- The right hand side is well defined, i.e. there is only a finite number of nonzero coefficients 
at Jxq 1 for given monomial J in variables different from xo . 

If w<p(x) = Jx^ 1 then w = w t u w-\ . . .w n _it jn w n , where \\ cp(t jlc ) = J and w k e W S _ T . 
There is only a finite number of possibilities for tj k and w k (notice that we have assumed that W St 
is finite). 

Proof of Proposition 4.1: Take a reduced word in S representing an element from W T and write it 
as 

(4.2) w tiwi . . .t n w n 

where ti e T and Wj are subwords in S — T. 

If the following word in Sj (representing the same element) 

(4.3) (w tiw~ 1 ) (w w 1 t 2 (w w 1 )" 1 ) . . . (w . ..w n _itn(wo . . .w^.-,)" 1 ) 

were not reduced, one would do some cancellations in (4.3), expand the result to obtain the word 
in S with smaller t v -i ( x ) for some x ^ Xo than that of (4.2). This would show that (4.2) was not 
reduced. 



Finally (4.2) and (4.3) define the same monomial. Thus the claim. 



□ 
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Theorem 4.4. Under the assumptions of the preceding proposition 

W„(x)| X0=1 =(#W s _ T )-(VVV) (pT (x). 



Proof : Any element w of W decomposes uniquely as w = wjwo where, wj G Wj and 
wo G Ws-t- We need to show that £<p-i ( x )(w) = £^-1 ( x )(wj) for any x 7^ Xo. 

Since £<p-i ( x )(wq) = 0, by the triangle inequality we have 



*<p-i (x)K) > ^-'(x)(wtWo) > V'W^oWo 1 ) = V'WN' 



□ 



./Vote: Two generators of Wj conjugate in W may not be conjugate in Wj, thus not every multi 
variable growth series of Wj is specialization of that of W. 

Corollary. Assume that J C S is as in Proposition 2.1. Let cp: S — > {xo, x} be sucn dial cp(t) = x 
if and oniy if t G T. Then the ordinary growth series of W T and W T are computed as follows: 

W T (x)=W tp (0,x), 
WtW W (p (1,0)' 

wbere (xo , x) is a multi-variable growth series of W associated to the allowable partition (p. 
Proof: W (P (1,0) = Ws-t(1) = #W S -t. 

5. Right-angled Coxeter groups and flag complexes 

Definition. A nerve N w of a Coxeter system (W, S) is a simplicial complex consisting of T C S 
sucn that the subgroup W T is finite. 

Remark : Some authors define a nerve as a baricentric subdivision of the above. 

Definition 5.1. A Coxeter group is said to be right-angled if m st G {1 , 2, 00} for alls, I G S. 

If W is a right-angled Coxeter group, then Wj is finite if and only if Wj> is finite for any two- 
element subset T' of T, therefore N w is a flag completion of its one-skeleton: T is a face of N w if 
and only if its one skeleton is contained in N w Such a simplicial complex is called a flag complex. 

On the other hand, let V be any graph. Let S denote the set of vertices of V. Declare 

r 1 if s = t, 
TTL st = s 2 if there is an edge joining s and t, 
1 00 otherwise. 

Then Nw is the flag completion of T. 
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Let X be any simplicial complex. For a given function cp: S — > I on the set of vertices one defines 
an f-polynomial of X by the formula 

(5.2) fx, v (x):=X; 11*00- 

o-ex sea- 
Proposition 5.3 [S, Prop. 26]. Let W be an arbitrary Coxeter group and cp an allowable partition. 
Then W<p (x) is a series of a rational function. Moreover, if W is infinite, then 

1 _y (~1) #T 
W„(x-i) ^ s (W T ) V|T (x)' 

where T runs over subsets of S such thai: Wj is finite, and x _1 = (x _1 ) x ei- 

Corollary 5.4. Assume that W is a right angled Coxeter group. Since no two generators are 
conjugated, any function cp: S — > I is an allowable partition and 



( 5 - 5 ) f N W)( p 



1 \ 1 



i + x ; w (p (x- 1 )' 



Proof: If W T is finite, then (W T ) (x) = [LetO + ^OO)' thus ( 5 - 5 ) follows form Proposition 
5.3. ~ □ 

6. Computation of f-polynomial 

Corollary 3.1 implies the following 



Corollary 6.1. W T is a right-angled Coxeter group if and only if 

(1) if s ^ T and t e T then m st G {2, 4, oo}, and 

(2) iff, t' G T then m tt ' G {1,2, oo}. 

Let us describe the basic example which will serve as a model for the general case. 
Definition. The Coxeter system (W, S) is of type if its Dynkin diagram is the following: 



, r ^ s k s k _-| s k _ 2 s 4 s 3 s 2 St 
(6.2) . . . ... . . 

Coxeter group of type B k is the group of symmetries of a regular k-dimensional cube. Assume that 
the cube has vertices with each coordinate equal to 1 or — 1 . In this case the generator s i corresponds 
to the reflection in the hyperplane defined by vanishing the first coordinate (si changes the sign of 
the first coordinate). The group W{ s 1 y is right-angled Coxeter group generated by reflections in the 
hyperplanes defined by vanishing of some coordinate. We will call such a hyperplane a coordinate 
hyperplane. 

The parabolic subgroup W{ S2i ... iSn } is the symmetric group of n letters. It acts by permuting 
coordinates. Precisely, s k transposes (k — 1 )st and kth coordinates. 
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Proposition 6.3. Let (W, {si , . . . , s m }) beoftypeB m . If is a family of n commuting conjugates 
of si then may be conjugated by an element from W{ S2> _ )Sk } in such a way that consists of 
all conjugates of st in W {s , ,... >Sn }. 

Proof: Family of reflections in coordinate hyperplanes is defined by the intersection of these 
hyperplanes. Since all such intersections can be conjugated by permuting the coordinates, provided 
they have the same dimension, the claim follows. □ 

Now return to the general question. Let 9 C Sy be a family of commuting generators of a right- 
angled group W T . The aim of the rest of the present Section is to compute the f-polynomial of 
N^r- in case when Wj is right angled, in terms of the Coxeter matrix of (W, S) (in contrast with 
Theorem 4.4, which gives the f-polynomial in terms of the growth series of W). 

In order to compute the f-polynomial of its nerve we need to determine maximal families of com- 
muting conjugates of generators. 

Theorem 6.4. Assume that T is as in Corollary 6.1. For any commuting family of conjugates 
of generators there is a unique subset E C S of the same cardinality as 0, such that 

(1) Ws is finite, and if for any t G T = T n E the set of vertices of the connected component of 
the Dynkin diagram of We containing t is denoted by E t , then: 

• E = UteT' ^t' 

• E t is of type B k(t) , 

• t is the unique element of E t fl T and it is the distinguished generator s-\ ; 

(2) there exists wq G W s _ t such that 

we©we = [J {wtw -1 |w G We} = {wtw -1 |w G Ws t }. 
te~p teT' 



Lemma 6.5. If G is a finite subgroup of a Coxeter group, then it is conjugate to a subgroup of some 
finite standard parabolic. 

Proof: Any Coxeter group acts on its Davis complex [Dl] which is CAT(O) (nonpositively curved) 
by the theorem of Moussong [M]. The only stabilizers of that action are the conjugates of finite 
standard parabolics. 

The claim follows, since any action of a finite group on a CAT(O) complex has a fixed point [BH]. 

□ 

Obviously, since the set of parabolic subgroups is closed under the intersection, there exist unique 
smallest parabolic containing G. 

Proof of Theorem 6.4: Since a family of commuting involutions generates a finite subgroup, by 
Lemma 6.5 we may assume that lies in a finite parabolics WV. Let T' denote a set of those 
elements of T whose conjugates appear in 0. 

We claim that T' C S'flT and moreover that each element of is conjugated to some element 
of T' by an element of WV. Indeed, by Corollary 1.2 each element of (being a reflection) is 
conjugated inside WV to some generator from S'. By Corollary 6. 1 no element of T is a conjugate 
of any other generator from S, thus the claim. 
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By Corollary 6. 1 any generator from T' may be connected in the Dynkin diagram to any other only 
by an edge labeled by 4. Thus by the classification of finite Coxeter groups ([B]), the connected 
component S[ of t G T' (within the Dynkin diagram of WsO is a graph of type for some k. 

Let S' = S' — UteT' ^t- F rom the definition it follows that any Coxeter group is the product 
of its finite parabolics corresponding to the connected components of its Dynkin diagram. Thus 
W S ' = W S / q x XteT' ^S' t - Since each element of is a conjugate of some element of T', we 
have C XteT' W s > • Moreover, if 6 t denotes those elements from which are conjugated to 
t G V then 6 t C W s ; . 

By Proposition 6.3 we may find elements w t G W$' such that each w t 6 t w^~ 1 consists of all 
conjugates of t in W St for a suitable subset E t C S' t . Since different W s ^ commute, setting 
We = IlteT' w t completes the proof. □ 
Note that determines E but E determines only up to conjugacy. In order to count all commuting 
families conjugate to we need to understand the action of W S _ T on the set of families as in 
Theorem 6.4 (1). 

Let E be such a family. The stabilizer of E is the centralizer of E in W S _ T , i.e. W So , where 



Where the sum runs over all subsets E satisfying Theorem 6.4 (1 ). 

This formula allows the following refinement. Assume that cr c t e N^y. The corresponding 
families E ff and E T satisfy Ef C E^ for all t e T. However if we set a and E such that Ef C E t 
for all t G T, then there are several t wit the property t D cr and E T C E. 

The centralizer of E ff act on the set of such t. thus the number of such t equals 



Definition. The link Lk ff of a a simplex in a simplicial complex X is a subcomplex consisting of 
all t G X such that T* = cfUTGXafidcrnT = 0. 

Corollary 6.7. Fix a simplex a G N^-. It is the commuting family corresponding to E CT C S. 
The f-polynomial of the link of a reads 



So = (U teT St) -T. 



Summarizing the above we have proved 



Theorem 6.6. The f-polynomial of Wj reads 




[W Eo :W E a]. 



fLlc ff) cp(t)= [We^W^J] 



(p(t) k w- kff w 



ede ct teT 



(k(t)-k-(t))!- 
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In this section we would like to present a specific triangulation of a sphere (which is a boundary 
complex of a convex polytope), such that its f-polynomial has non-real roots. Other such examples 
are constructed by a different method in [G], where the reader may also find a connection of the 
(former) conjecture on real-rootedness of f-polynomials of such triangulations to geometry and 
combinatorics with further references. 

Let W be defined by the following Dynkin diagram: 



ti t 2 

(7.1) t> "-- ' • ' = 



Let T = {ti , tz} consist of white dots in the Diagram 7.1. Recall that Wj = ker(Ws — > Ws_t)- 



Remark 7.2. N^j- may be realized as a convex triangulation of a sphere, i.e. a boundary complex 
of a convex polytope. 



Proof: Consider the group defined by the following Dynkin diagram: 



• •- 



-• ■ •- 



It can be realized as a finite covolume reflection group in the hyperbolic space with the fundamental 
domain D a simplex with unique ideal vertex [B, Ch. V, §4, Ex. 17]. Let D = Ws • D. It is 
a convex hyperbolic polytope with some ideal vertices. Finally let D* be D with ideal vertices 
truncated. Is is a polytope dual to . 

Since D* may be realized as a convex polytope in the Klein model of the hyperbolic space, the 
polar dual of D* realizes as a convex triangulation of a sphere [Z, Cor. 2.14]. □ 

According to Theorem 6.6 we have to find all suitable triples {E tl , E t2 , E }. They are listed in the 
following picture. Black dots in the connected component of tt are elements of E tt . The remaining 
black dots (in the middle) are the element of Eq. 
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8 
7 
6 
5 
4 
3 
2 
1 



-• — • — • — c=^ 



-• • • ^=3 



o--o •- 



-• — • — • — c=^ 



The orders of finite Coxeter groups are well known ([B]) Substituting the above to Theorem 6.6 
one obtains 



f N (ti,t 2 ) = 696729600 (( 



2t|tj 
5040 

+ ( 



h8 



+ 



40320 



+ 



tft! 



+ 



+ 



720 5040 2-5040 



+ 



2-2-120 2-720 



;) + ( 



t 4 2 U 



+ 



+ ( 
+ ( 



tfti 
6-192 
t 2 ti 



+ 



+ 



24-120 



) + ( 



24-24 2-6-120 

tit! 



) 



23040 2-51840 



) + ( 



2-1920 
ti 



+ 



+ 



6-1920 

t 2 



) 



+ 



1 



322560 2903040' 696729600 



;) 



= t] (276480 1 7 2 + 967680 1| + 1 451 520 tf + 1 109600 \\ + 604800 tf 
+ 181440 \\ + 30240 1 2 + 2160) + ( 1 7280 tf + 207360 \\ 
+ 483840 tf + 483840 \\ + 241 920 1£ + 60480 1| + 6720 1§ + 240 1 2 + 1 ). 



Therefore, in particular, 



f N _(t, t) = 293760 1 8 + 11 75040 1 7 + 1 935360 1 6 + 1 693440 1 5 + 846720 1 4 
+ 241 920 1 3 + 36960 1 2 + 2400 1 + 1 . 
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and 



1 



t 8 - 2392 * t 7 + 201 88 * t 6 - 70504 * t 5 + 1 07590 * t 4 

-70504 * t 3 + 201 88 * t 2 - 2392 * t + 1 



W-r(t) (1+t) 8 

Thus the poles of Wt(-) (with 2 digit precision) are: 0.41 • 10" 3 , 0.24±0.16i, 0.63, 1 .6, 2.9 ± 1 .9i, 
2.4 • 1 3 . This provides a first known counterexample to the Real Roots Conjecture [G]. 

The link L (of codimension 2) of a face 



is a triangulation of a five dimensional flag sphere. Using Corollary 6.7 we check that fi_(— 1/2) ^ 0. 
A link K (in L) of an edge defined by 



• o- 



satisfies f K (t) = (1 + 2t) 4 , which is an f-polynomial of a cross polytope (and, as follows, K is a 
cross polytope). 

Such a pair (K, L) allows us to construct a triangulation of a five dimensional sphere which is a 
counterexample to the Real Roots Conjecture [G, Th. 5.2]. Five is also the smallest dimension 
when this is possible [G, Th. 3.2]. 
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